I had to let go of my family. You are not responsible for your family's bad behavior, and there is nothing wrong in not allowing yourself to be treated badly by them. When they want to act like normal human beings they are welcome in your life until then, they are only victimizing themselves. They are trying to manipulate and control you, don't fall for it.
After many years my parents finally came around and we have a decent relationship, my siblings still do not speak to me. And it's better that way.